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The present invention relates to portable computers and more particularly 
but not exclusively to hand-held computers of the kind sometimes referred to as 
5 personal digitaLassistants.^ . 
£> A personal digital assistant includes data files defining such items as an 

electronic diary, address book and other applications such as word processing 
software, calculators and the like. As more powerful memories and processors 
have been developed in smaller packages it has become possible to provide quite 
_ 10 powerful computers in relatively small portable cases. However, the limitation of 
miniaturisation occurs when a viewing screen and keyboard are needed for data 
input and read out. Thus, so called palm top personal computers (PPC) are usually 

H of the order of 1 5 cm by 7 cm in order to provide a readable screen and a usable 

HI 

1^ keyboard. Such palm top computers are known, for example Psion Corporation 

jyp 1 5 have produced a Psion Series 5 (trade mark) PPC having an 8 megabyte RAM and 

LI processor while Hewlett Packard similarly produce PPCs as e.g. the HP320LX 

5 5 _ (trade mark). The capabilities of such PPCs may be enhanced by incorporating so 

p called flash cards enabling the expansion of the RAM by up to 10 megabytes or 

If, more while PCMCIA cards may be provided to enable connection of the PPC to 

J3 20 telephone networks by way of cellular 'phones or telephony sockets for 

™ communication with other computers and the so called Internet and Intranets. 

Most PPCs incorporate a docking arrangement to enable them to be 
connected with a desktop computer or other main frame for the purposes of 
synchronisation of data files and the like. 
25 However, generally speaking PPCs are not robust and are prone to damage 

mainly because of the clam shell design requiring a hinge that opens to reveal the 
incorporated keyboard and screen. Thus PPCs are more usually used on a desk top 
or table or may be held in one hand while typing with the other. 
^ According to the present invention there is provided a portable computer 

30 including movement detection means responsive to movement of the computer to 
produce an electrical output signal representative of such movement, processing 
means responsive to the output of said position detection means to determine 
detected movement data defining a user's intention, the processing means using 
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said data to provide a mode response selected from a multiplicity of stored 
possible modes. 

Preferably the movement detection means includes at least one 
acceleration or tilt detection means responsive to movement of the computer to 
5 produce the output electrical signal. There may be a plurality of acceleration 
detection means each producing a respective electrical output signal representative 
of movement components in respective directions, the detectors generally being 
mounted to detect X and Y movement components at a ninety degree angle. 

The processing means may include a data input mode in which detected 
10 movement data is used to generate alphanumeric or graphical data. The 
^ alphanumeric or graphical data may be stored in data storage of the portable 

%S computer or may be output by transmitting means to receiving means connected 

^ s to another processing device. 

The processing means may include a screen output mode in which 
fy 1 5 detected movement data is used to modify output to display means of the 

^ computer whereby scrolling of displayed information is effected. In the screen 

M: output mode the processing means may be responsive to relative lateral tilting 

movement to cause the display of information stored as to one or other side of 
currently displayed information. Relative rolling movement may cause the display 
20 of information stored as above or below the currently displayed information. 

In the screen output mode the processing means may be responsive to 
detected movement data to determine a most likely orientation of the computer 
display means with respect to a user's eye line whereby the signals output to the 
display means may cause inversion of the displayed information such that the 
25 computer may be held and used in either hand. 

<The computer may include proximity detection means arranged to provide 
signals indicative of the proximity of the display screen to a user's view, the 
processing means being responsive to changes in the relative proximity to increase 
or decrease density of displayed information. 
30 In a further development, security data derived from movement of the 

computer defining an authorised user's password is stored, the processing means 
being locked in a secure mode until detected movement data corresponding to the 
security data is received. 
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The computer may include a sound input device , the processing means 
having a second data input mode in which alphanumeric data is derived from input 
speech signals. A sound output device may also be included to permit the output 
of speech derived from stored data. Alternatively the sound input and output 
5 devices may be combined with a radio transceiver whereby cellular or other radio 
telephony networks may be used. 

The computer may be housed in a casing shaped to facilitate a user 
holding the computer as if holding a writing stylus. The casing is preferably of 
substantially radiused triangular cross section along a substantial portion of its 
10 length and may include a flattened section incorporating a display screen. The 
casing may include angular shaping between a forward holding area and a rearward 
screen area the shaping being such as to provide a natural viewing angle of an 
incorporated display screen while the casing is held as a writing stylus. The 
shaping may also be such as to facilitate support of the rearward screen area by 
1 5 the dorsal aspect of a user's hand between the root of the thumb and index finger 

A portable computer in accordance with the invention will now be 
described by way of example only with reference to the accompanying drawings of 
which: 

20 Figure 1 shows a plan view of the computer; 

Figure 2 shows a side view- of the computer of Figure 1 : 

Figure 3 is a block schematic diagram of the circuits of the computer of 



Figure 1 ; 



f i gure A is a circuit diagram showi 



i gtirc 1 Is a circuit diagram showing details of the circuitry described with 
25 respect to Figure 3; 

Figure 5 is a circuit diagram of a docking station to enable the computer of 
Figure 1 to be connected to a desktop or other device; 

Figures 6 to 9 are flow charts showing some of the programs incorporated 
in the microprocessor of Figure 4; 
30 Figures 10 to 13 are graphical representations of the outputs of the 

accelerometers of Figure 4 as analysed by the microprocessor; 

lpanson of the representations of the outputs 



jineieri ui ngure *+ as anaiysea D 
Hcfcir . a - T1 is a graphical compari 



of the accelerometers as shown in Figures 10 to 13; 
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Figure 1 5 is a schematic diagram of a power saving arrangement of the 
portable computer of Figure 1; 

Figure 1 6 is a schematic diagram of a voice input arrangement of the 
portable computer of Figure 1; 
5 Figure 17 shows mounting positions of the accelerometers of Figure 4 

with respect to each other; 

Figure 1 8 is a table showing a program response to movement of the 
accelerometers of Figure 1 6 in a particular mode of operation; and 

Figure 1 9 is a schematic diagram of a part of a scroll detector of the 

Referring to Figures 1 and 2, the hand-held computer of the present 
invention has a case 1 of a moulded plastics material having a triangular barrel 
cross section towards the forward end, that is towards the point, with radiused 
sides providing a diameter of approximately 15mm. The case is shaped to have a 

15 curve so that when the forward part of the barrel of the casing is held as a writing 
stylus using the thumb, index finger and second finger of the user, the screen area 
A-A rests comfortably on the dorsal area at the back of the hand between the root 
of the thumb and index finger of the hand and the user's wrist.. This provides 
some additional support to allow the entire computer to be operated using one 

20 hand only. After assembly the case is sealed using an O-ring seal much in the 
manner of sealing watch parts. Coating the casing with wax polythene completes 
the sealing of the unit so that to all intents and purposes the case is waterproofed. 

The casing is weighted at one end (for example by including a 
rechargeable battery 2) at the forward end so that if the item is dropped on to a 

25 surface it tends to fall in a specified manner such that the tip which may include 
some impact protection, for example by being rubber cased, prevents any 
significant damage to internal components. The weighting also assists balancing 
of the unit in a user's hand. 

The case may incorporate a hook 3 for attachment of a strap or key ring 

30 (not shown) and may have a pocket clip 4. The hook is preferably recessed within 
the casing. 

Externally mounted a small liquid crystal diode screen which may be of the 
kind manufactured by Batron and supplied under type number BT42003STYC is 
included. To either side of the LCD 5 touch or pressure sensitive switches 6 to 1 3 
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are provided. These switches may be soft programmed to provide functions as 
hereinafter described. A touch scroll strip 14 (hereinafter described) is provided in 
front of the screen 5 and the system includes a pyroelectric detector 1 5 used in 
determining the proximity of the computer to a user's eye. 
5 Audio input and output devices are also provided together with an alerting 

device. For example, a microphone 16, annunciator 17 and speaker 18 may be 
£ included. Finger switches A%^ 4 are provided forward of the annunciator 17 

and again may be soft programmed for functionality. Also visible are gold docking 
pins 21 used for connecting the hand-held computer for recharging of the battery 2 
10 and transfer of data by way of a docking device to other computers, for example 
desk mounted personal computers. 

As an alternative means of transferring data from the computer of the 
invention to another processing device or to enable the computer of the invention 
}^ to be used as an input device for a PC, an infrared transceiver -22 is mounted 
1 5 towards the front of the casing 1 . 

Also included is a light emitting diode 23 which may be of the kind having 
three or more colours. Individual colours allow for a small amount of illumination or 
may be used to provide indication or alarm functions. Alternatively, a single 
coloured red light emitting diode part TLSH180P from Toshiba may be used. This 
20 ultrabright LED aids human night sight viewing and whilst only being of low power 
may in a dark environment assist the user. 

Turning now to Figure 3, a block schematic diagram of the component 
parts of the computer is shown. It will be noted that the display 5 receives inputs 
from a microcontroller 30 which may be of the type supplied by Microchip under 
25 the reference PIC16C74. The PIC16C74 includes on board read only memory 



/" (ROM) but in a preferred embodiment an ARM processor with a larger memory is 
^y^JtvV used. Also mounted within the casing 1 are two accelerometers 31, 32 which 

y\^L^^ m3V k e °f t * ie kind kr >own as ADXL05 from Analog Devices Limited and which are 

buffered by operational amplifiers, for example National Semiconductor type 



30 LPC662. The keys 6 to 13 and 18 to 20 are here represented as a keypad 33. 
Some of the keys may be used to control a speech recorder 34 which is also used 
as an interface between the microcontroller 30, and microphone 16 and the 
speaker 18. A radio transmitter 35, which may be a radio transceiver, is also 
incorporated. 
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One function of the radio transmitter may be to allow use of the hand-held 
computer of the invention as an input device for a desk mounted or other PC 40 
having corresponding receiver 36 and an appropriate converter without physical 
interconnection. Other functions of the transceivers 35, 36 may be apparent from 
5 the description hereinafter. . , 

Referring now to Pi^uro- the microcontroller 30 is connected to the 

As 

display 5 using standard control inputs of the display to provide a visual output of 
the result of program activities requested by the user. It will be noted that the 
accelerometers 31 and 32 have associated buffer circuits which each include an 

10 operational amplifier to buffer the input to the microcontroller. The operational 
amplifiers 41 may be type LPC662 from National semiconductor. 

Power to the accelerometers 31 is by way of a transistor TR2 so that if 
the microcontroller 30 determines that no movement of the computer is occurring 
or that the present program does not require use of the accelerometers 31 and 32, 

15 output RB1 may be set to stop current being drawn to minimise battery usage. 
The microcontroller may allow periodic sampling during dormant periods so that if 
the computer is picked up the sensors may again be activated. 

An EEPROM integrated circuit chip type X24F064 8 Kbyte from Xicor 
providing 8 Kbytes of memory is also provided accessible from the microcontroller 

20 30 in known manner. Switches S1 to S8 (keys 33 in Figure 3) are wired to 
respective inputs of the microcontroller 30. 

Note that TR1 controls power input to the back lighting circuitry of the 
LCD display 5. Again, the microcontroller 30 will normally bias TR1 off when the 
computer is dormant and will maintain TR1 biased off unless back lighting is 

25 requested by operation of one of the keys of the keyboard 33. 

For the avoidance of doubt it is here noted that the microcontroller 30 
includes a program which uses position outputs from the accelerometers 31, 32 to 
determine from the orientation of the computer whether the hand-held computer is 
in the left hand or right hand of the user. It is here noted that accelerometer 

30 output may depend upon the tilt angle of the included accelerometers to the 
earth's gravitational field. The keys S1 to S8 are then swapped over in soft 
programming mode such that functionality is determined by the apparent top of the 
display 5 to the user in its current position. Similarly, determination of orientation 
of alphanumeric or other display information on the screen 5 will be determined 
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from the orientation of the computer itself. Thus, data output to the screen from 
the controller 30 arranged to provide an appropriately oriented display. 

The speech recorder 34 is implemented using Sequoia technology sound 
recording integrated circuit type ISD2560. The Sequoia technology chip is capable 
5 of recording 60 seconds of speech message in digital form and is connected so 
that the microphone 16 can be used to provide an input. The three switches SW1, 
SW2 and SW3 may correspond to the fingertip switches 1 8 to 20 of Figure 1 or 
may be selected in software from keys 6 to 13. 

In speech recording mode SW1 provides a start and pause control function 
10 for the user, SW2 is a stop or reset function while SW3 switches between the 
record and play modes. 

Short messages are played back by way of the loud speaker 18. As 
currently implemented the microphone 16 is a Maplin type QY62S, the speaker is 
from Hosiden type HDR9941. "Speech notes" recorded by this method may be 
15 down loaded to a PC for sorting and categorising. 

Turning briefly to Figure 5, the hand-held computer of Figure 1 can be 
inserted in a corresponding docking port shaped to align the contact 21 with T5 to 
T7 of Figure 5. The contact T5 and T8 provide serial receive and transmit paths 
for synchronising databases between a PC and the portable computer and also 
20 provide battery charging. Contact T7 provides an earth contact. Speech samples 
and other data may be up loaded from a PC to the portable computer. 

A Maxim integrated circuit 42, which may be type MAX232IC, converts 
RS232 level serial output and input required by current PCs to the voltage level 
required by the microcontroller 30 of Figure 4. Note also the ability to receive 
25 radio input by way of an antenna connected to the radio receiver chip type 
AMHRR3-418. 

Having discussed the hardware of the portable computer of the invention 
we shall now consider various uses to which the writing stylus input, voice input 
and screen may be used. Exemplary flow charts for some aspects of the use of 
30 the portable computer are attached. While functions are individually discussed in 
respect of the flow charts of Figure 6 to 9, it will be appreciated that combinations 
of programs may be used in the implementation of features described hereinafter. 

Turning now to Figure 6, the tilt sensor software uses inputs from the 
accelerometers 31, 32 which, as shown in Figure 1 7 to which reference is 
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additionally made, are mounted with their respective sensitive axes at right angles 
to each other. As will have been seen from Figure 4, the output from each 
accelerometer is filtered by a resistor capacitance network to remote high 
frequency noise for example, and the outputs are then read by an analogue to 
5 digital converter included within the microcontroller 30. Thus, referring to Figure 
6, for special sensing the microcontroller 30, display 5 and analogue to digital 
conversion circuits are initialised at 100 and the interrupts and port pins of the 
microcontroller 30 are reset or cleared at 105. The output of the accelerometers 
31, 32 is read from respective analogue input pins ANO and AN1 of the 
10 microcontroller 30 and an index to a look up table is calculated at step 1 10 using 
the formula I = a + (b1 x 16). In this case a is calibration constant and b1 is the 

yO digitised output of the accelerometer 31. This allows for a look up table allowing 

a16 by 16 matrix of left to right position to be determined. For vertical tilt position 
the formula I = a -f (b2 x 16) where b2 is the output of the accelerometer 32 may 

m 15 be used to address a further matrix to determine the relative up/down position. By 

4i applying one or more of the indices to the look up table iL is possible to select one 

M: of n screen positions or to determine the amount of movement since the last 

ass. 
s ; 

^T; reading at step 115. The system then waits for 10ms as indicated at step 120 

tf) before repeating the reading of the accelerometer output. 

20 The program allows for the screen 5 to be scrolled in accordance with the 

user's requirements. The mounting of these sensors, as shown in Figure 17, 
allows posiitonal movement such as up, down, left and right to resolved to 
fractions of a degree. 

Using software the microcontroller 30 may use the output from the 

25 accelerometers 31, 32 to determine a user's requirement for a different view to be 
displayed on the screen 5. Thus a virtual hinge is created such that if the user 
moves the stylus whilst it is in viewing position the screen information may be 
changed to respond to a natural reaction for looking up or down or to the left or 
right. Thus, as shown in Figure 18 in a simplified arrangement, if the display on 

30 the screen at any time is designated as current page (CP) then tilting the stylus 
towards the left will cause the display of a page stored as to the right of CP (CR). 
The page which was formerly CR (as represented by data held within the storage 
of the microcontroller 30 or an associated data store) is now CP. Tilting the stylus 
to the right will cause a page of information (CD to the left of CP to be displayed. 
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For the avoidance of doubt the term page is used here as for a screen for 
information. Thus the action of tilting the stylus to the left or right is analogous to 
the natural inclination to look through a window towards the right or left to obtain 
additional information from a scene. 



5 Similarly, if the stylus is turned towards the user information stored at UC 

will be displayed and tilting the stylus away results in the information DC being 
displayed. It will be appreciated that combining tilt angles may result in the display 
of information up and to the left (UL), up and to the right (UR), down and to the 
left (DL) and down and to the right (DR). This simplified description of a multiple 
10 line screen moving as if a jump is occurring should be considered as allowing single 
Q line scrolling in which CP defines the top line of the screen, DC the line below and 

r: further lines to the limit of screen viewability also being displayed with CP such 

Nl that single line scroll movement or smooth scrolling appears to occur. Finer 

scrolling modes such as single pixel movements are also possible. The user may 
\~ 15 select the rate of response using keys 6 to 1 3 or fingertip switches 18 to 20. It 

s should also be noted that the tilt sensor arrangement 31, 32 allows the 

pi microcontroller 30 to determine the most likely viewing angle and to adjust pixel 

fU mapping to the screen accordingly so that if a user holds the stylus in the left hand 

if the display is inverted to that shown in Figure 1 so that the bottom right corner, as 

33 20 viewed by a right handed user, becomes the top left corner as viewed by a left 

handed user. It should be noted that the microcontroller does not require an input 
from the user to determine whether the stylus is being held in the left or right hand 
and, if a user changes hands during the course of viewing the screen output will be 
inverted accordingly. 

25 It is also possible, particularly if pictorial rather than alphanumeric display 

is required, for the screen to enter a "portrait" mode if the stylus is held vertically. 
In this case the orientation will be appropriate to the stylus being held with its tip 
above or below the waist of the stylus. 

To prevent scrolling or orientation change the user may use a soft key 6 to 
30 13 or fingertip switch 1 8 to 20 to lock and unlock display movement. 

Further, while as described with reference to Figure 3, the display screen 
is a Batron, in a preferred embodiment a Kopin Cyberdisplay 320 having % VGA 
colour resolution may be used. Using the Kopin display and the associated 
monocular viewing lens mounted end on to the body allows clear viewing of some 
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15 lines of normal text. The Kopin Monocular lens is approximately 20mm by 
18mm which gives an acceptable size to a pen body incorporating movement 
sensing means as herein described. 

In a still further development the pyroelectric detector (Murata type IRA- 
5 E700ST0) 15 may be used to detect the presence of the user and the proximity of 
the user to the viewing screen 5. Using the Kopin V* VGA display it is possible to 
decrease the size of character displayed. Thus the microcontroller 30 uses the 
output of the pyroelectric detector 1 5 to determine how close to a user's eye the 
stylus is held and may adjust the size of print so that more characters are fitted on 
10 the screen 5. In this way large areas of text may be read by holding the screen 
Q close to the user's eye. A further use of the pyroelectric detector for power saving 

rf purposes it discussed hereinafter. As has been mentioned detection of the 

SJ position of the screen with respect to the user's left or right side is possible. 

[ft Referring to Figure 8, clearing of interrupt and set port pins and 

15 initialisation as previously mentioned with regard to Figure 6 is carried out. One of 
3 the accelerometers, for example the accelerometer 31, is read at step 200 and its 

Li value compared with a predetermined value m. Values greater than m indicate that 

ry the display is most likely in the user's left hand so that as indicated at 215 

~1J inverted characters are displayed on the screen 5. If the value read from 

CO 20 accelerometer 31 is less than m then it may be assumed that the stylus is in the 

user's right hand and normal ROM LCD characters are displayed. As indicated at 
220, a check may be carried every 10ms to determine the whereabouts for the 
screen. 

It is envisaged that input to the computer system either for use as a PDA 
25 or for word processing purposes, will be carried out either by hand writing 
recognition (HR) or by voice input using the microphone 16. Handwriting 
recognition does not require the user to write on a surface, although some users 
may find this a preferable method of operation, but requires the user merely to 
move the stylus (that is the whole computer) as if writing letters and numbers. 
30 Katakana or Cyrillic texts may also be entered as may symbols. 

Thus using one of the two accelerometers 31, 32 and referring to Figures 
10 to 14, the output of one of the accelerometers 31, 32 is read at a simple rate 
of 100 times per second. The received data is stored in a random access memory 
(RAM) buffer as a set of acceleration values against unit time. Using a software 
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process of autocorrelation the microcontroller 30 may determine the character 
entered. Thus, referring to the Figures, Figure 10 shows three entries of the letter 
C, Figures 1 1 shows three entries of letter B, Figure 1 2 3 entries of letter F and 
figure 13 three entries of letter H for exemplary purposes only. Feedback to the 
5 user either on the display or by character speech output or simply by an acoustic 
beep indication may be used to note acceptance of a character. The validity 
indication may be user selectable. 

It will be noted from Figure 14 that a single accelerometer output is 
distinct for each of the input characters and therefore the microcontroller can 
10 determine the entry made. The entry may be of text which can be reflected to the 
viewing screen 5 or maybe instructions couched in appropriate terms such as "get 
Monday diary". Once the diary has been recovered from the store the appropriate 
entries may be displayed on the screen 5 with appropriate soft key indications for 
the keys 6 to 1 3. 

15 Note that predefined user gestures such as drawing an "envelope" to 

request e-mail mode or a table for diary mode, for example, may be used. The 
instructions may be user selectable or teachable so that on initialisation the user 
draws and selects the mode. Subsequently drawing the same symbol will cause 
the microcontroller 30 to enter the appropriate selected mode. 

20 Again sensing may be used to move around the displayed area (as 

discussed with reference to Figure 6 and Figure 18) or the touch strip controller 14 
may be used in combination with the keys 6 to 1 3 to select appropriate areas. 

Entry of information to the diary may also be by handwriting input. It is 
convenient here to consider the construction of the touch strip 14 which as shown 

25 in Figure 19 comprises a 0.4mm printed board having a surface area of 
approximately 20 mm by 5m with horizontal strips in the 5mm dimension as 
indicated as 47 to 50 for Figure 19 which shown a part of the strip 14. The strip 
14 thus replaces the rotational elements of potentiometer so that hermetic sealing 
of the casing may be complete and a control which is resistant to wear as 

30 provided. The strips 47 to 50 etc, are interfaced to the microcontroller 30 so that 
as a finger is moved across the strip direction of movement and speed of 
movement may be determined. The information may be used in the same way as 
a rotary potentiometer. 
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It will be appreciated that incorporating a second strip at right angles to 
the strip 14 would allow full functionality of (eg) a computer mouse to be 
simulated. 

Thus as shown in figure 19, if a user moves a finger such that, for 
5 example, the presence of the finger bridging 48, 49 and 50 subsequent to the 
presence of a finger bridging 47 to 50 indicates that the user would wish to rotate 
a potentiometer in a counter-clockwise direction. Similarly, detection of a finger 
bridging 47 and 48 subsequent to there having been no previous bridge indicates 
rotation in a clockwise direction. 

10 It will be appreciated, however, that if the tilt detection mechanism 

hereinbefore described indicates that the device is in the left hand rather than the 
right hand the functionality of bridging and unbridging is reversed accordingly. 

Entry of data files, for example the composition of letters or reports can be 
carried out using either the write sensing arrangement, hereinbefore described, to 

15 determine input alphanumeric which may be stored for subsequent transmission to 
a printer or for transfer as data files to a PC for example. Data entered and 
converted into appropriate stored information may be displayed on the display 
screen if required. 

Cursor movement around the display screen to select a position to which 
20 information is to be placed may be by use of either the potentiometer arrangement 
described with reference to Figure 1 9 or by use of the tilt sensing mechanism 
hereinbefore described in combination with one of the soft keys to indicate that an 
insert or delete position is being selected. ^ 

In an alternative method of operation and referring to Fiqure-7~and initially 

7b 

25 to Figure use of the stylus of Figure 1 as a non-connected input device for a 
As 

PC allows all of the functions of the hand held computer to be duplicated. For 
example, where alphanumeric data is input in the manner previously described with 

t> reference to Figures 10 to 14 a more powerful PC may be able to a ^cfr 
autocorrelation much more rapidly than the microcontroller 30 of the device itself. 

30 In this case, referring specifically to Figure once the initialisation process has 
been completed at 100, one or both of the accelerometers may be read at 705 at 
10ms intervals as indicated at step 710 and the voltage data is transferred to the 
serial port for transmission by the wireless link or by use of infrared transmission. 
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A corresponding program in the PC itself will read from radio receiver 36 
and the receive port the data defining the voltage from one or both the 
accelerometers. Autocorrelation will be carried out on the reading to generate 
appropriate characters at step 725, the characters being displayed on the PC 
5 screen at step 730 and possibly being transmitted back to the hand-held PC. 

In an alternative implementation autocorrelation may be carried out within 
the microcontroller 30 and data defining input characters themselves be 
transmitted to the PC. 

Note that the transmission of comma separated variables (CSV) format 

10 ASCII is transmitted at 418 MHz using an amplitude modulated radio transmitter 
from RF Solutions of Lewes East Sussex UK. In the PC CMOS voltage levels 
converted by the RS232 conversion unit can be used to provide raw data to the 
PC. Windows 3.1 terminal software is capable of reading CSV data and 
spreadsheet can read and plot data graphically. 

1 5 In a still further use of the acceierometer 31, 32 arrangement password 

protection of the hand-held computer may be provided. Thus, once trained to a 
user's signature, for example, a stored waveform corresponding to acceierometer 
voltage outputs read at 10ms intervals can be used. Thus the user does not 
require to remember any special passwords and cracking of the signature code is 

20 extremely difficult since, for example forging a signature will result in a different 
acceleration pattern to that of the natural signature writer. 

Thus it may be possible to use a hand-held computer of this nature to 
provide transmission of security information for, for example, electronic point of 
sale authorisations, access restriction and the like. 

25 A still further use of the transmission and reception capability allows a 

local area paging system to be developed. Thus if several users work in 
reasonable proximity to each other it is possible to transmit message directly from 
one hand-held computer to another such that, for example, telephone messages 
taken by one person in an office and files created may be transmitted using a 

30 digital serial identity to another specified hand-held computer unit. 

Turning to Figure 16, in addition to the simple 60 second voice note 
storage chip 34, the microphone 18 may also be connected by the amplifier and 
filter arrangements to provide voice input to the microcontroller 30. Voice 
recognition software can thus be used to convert the voice input to data, the keys 
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or fingertip switches 1 8 to 20 having appropriate use for pause, record, etc as 
hereinbefore described with reference to the spoken memorandum chip. 
Converted data can thus be transferred to the memory or displayed on screen or as 
hereinbefore described with reference to using pen input for handwriting 
5 correlation by a PC serial data to the PC representing the voice input can be 
provided. This is indicated at 39. 

In an alternative method of working, the microcontroller causes storage of 
the speech input in the memory 38 without effecting conversion, the information 
being transmitted via the serial output port either in the docking station or by the 
10 radio link to a PC which may use voice recognition software to carry out the 
„ conversions. It may be preferable to use a PC to carry out the conversion rather 

than a microcontroller incorporated in the pen since significant processing power 
may be required. However, the inclusion of voice recognition software in the 
^ microcontroller 30 is possible. 

flj 1 5 It will also be realised that a data store may be used to store received 

^ speech signals. Thus several speech notes each time/date stamped may be held 

M for subsequent use. If a suitable store is included then the speech storage chip, 

«j hereinbefore described, may be omitted from the stylus to allow additional memory 

-S chip space. 

m 20 wi " be noted that since the hand-held computer of the invention includes 

microphone, loudspeaker and function keys use of the device as a cellular 
telephone is also envisaged. 

Where cellular phone functionality is included within the stylus or where 
the stylus is in contact with a PC for example by IRDA or radio transmission, the 
25 use of the microphone input for substantial dictation purposes is possible and also 
the use of substantially larger data files than could otherwise be stored locally. 

Thus the input speech will be stored in a buffer by the microcontroller 30 
and periodically, when the buffer contains a substantial amount of data, a network 
connection to either network data storage means or to a predetermined PC is 
30 effected. Stored buffered data is then transferred to the remote location. Since 
the network connection is not permanently required the cost of transferring the 
data by this means is less significant and periods of network signal weakness can 
be overcome. 
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Data buffered in this manner may be date and time stamped or, if the 
stylus incorporates GPS (global positioning systems) may be location stamped also. 

Data may similarly be recovered such that large text documents required 
by a user may have portions stored in the buffer for display and sequential 
5 recovery of other parts of the document from the remote location using telephony 
as required. Photographic data, for example from a digital camera, may similarly 
be saved to the network by way of the buffered store. 

The various functions above described enable the provision of a full PDA 
function including diary alarm and scheduling functions as well as data input, file 
10 creation and storage. The user may select the mode of operation using either soft 
buttons or movement input and the use of the accelerometers 31, 32 is 
determined from the mode selected by the user. Electronic mail and fax facilities 
may be incorporated in the PDA functions allowing reception or transmission of 
data via the unit. The transmission capability of the unit may be associated with a 
15 receiver in a printer for example or a printer incorporating a docking station may be 
used to allow the printing of data from the PDA. Note that infrared transmission 
may be used. 

As will be appreciated one of the major problems with any hand-held 
portable device is the use of rechargeable batteries which have a limited power life 

20 between charges. The hand-held computer of the present invention therefore 
incorporates a number of power saving facilities arranged particularly to close 
down back lighting of the small LCD screen 5 if it is not appropriate. Thus if the 
accelerometers indicate that there is no current usage of the system then powering 
down of the detection circuitry and back lighting of the screen may occur. 

25 However, in a further use of the proximity detector 1 5, it is possibl^to turn back 
GL' lighting on and off in dependence upon whether the user is looking information on 

the screen or not. Thus, referring to Figure 1 5, the pyroelectric detector 
conversion detects presence of movement to maintain back lighting. Pyroelectric 
detectors tend to detect presence of a person by movement through a parallel 

30 beam of infrared such that when movement is detected across a Fresnel lens an 
AC signal is generated. 

Thus the pyroelectric system can be used to detect the presence of a user 
and in the absence of use power down of the back lighting at least may occur. 
Infrared sensors may similarly be used to detect the presence or absence of body 
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heat. Note the pyroelectric detector, as previously described, can be used to 
control the character zoom feature hereinbefore described. A suitable detector is a 
Murata type IRAE700STO. 

In a further implementation of back lighting power down which is 
5 responsive to the viewer's vision in addition to the viewer's presence. It is known 
that when a subject looks directly at a lens and a flash occurs blood vessels at the 
rear of the eyes reflect back to the camera. It is thus possible to periodically flash 
a low level light and to sense red reflection using a photodiode sensor. Thus as 
shown at Figure 15, the microcontroller 30 periodically causes an LED 60 to pulse. 
10 At the same time a photodiode 61 is monitored and, assuming presence of a user's 
^ eye 62 reflecting light from the pulse, the LCD will remain back lit as indicated at 

43 58. It is further noted that a custom-built solar cell (not shown), for example a 

lj Solarex available from Farnell Electronics, may be used to assist triple charging of 

H the battery 2. 

nj 15 If a user is not looking directly at the screen at the time the LED 60 is 

^ flashed there will be no reflection and the photodiode 61 will not activate. The 

^ microcontroller may therefore power down the back light 58 thus reducing the 

£ drain on the rechargeable battery 2. 

y 

o Although the present invention has been described with reference to a 

20 particular implementation using accelerometers other position detection and 
location means may be used to implement movement detection arrangements. 
While herein references made to alphanumeric data it will be appreciated that 
katakana character and Cyrillic script inputs may also be detected using the 
acceleration method hereinbefore described. 
25 Note when the hand-held computer is docked with a PC or is receiving 

data by way of cellular or radio transmission it is possible to display received 
£ tnformation on the screen 5. Thus as indicated at Figure 9 a&dr initialisation 
£ message is output to the screen 5 and appropriate buffer is cleared. As characters 
are received at the serial port^are transferred to the microcontroller at 905 and 
30 checked for frame validity at 910. Assuming that there is no error at 910 and that 
the received character is not a clear screen message as indicated at 915 then a 
character is transferred to the LCD 5 for display at 920. 
^ Further possible uses of the portable computer of the invention include/5 

storing large numbers of speech modes which when down loaded to a PC with the 
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pen either in a docking station or by IRDA or radio transmission are sorted. In this 
process the PC converts the each of the speech notes to text and scans the text 
for frequently occurring words, for example "meeting" and then sorts the stored 
notes into sub-directories. Alternatively, notes may be sorted by date, subject 
5 matter or size as will occur with a normal windows file. Key control words such 
as "alarm" may result in the speech note being converted into a timed alarm which 
may then be written back to the portable computer so that at the appropriate time 
the portable computer either announces the alarm or a vibrate to alert the user, the 
alarm being displayed as a text message. It will be appreciated that if a 

10 sufficiently powerful microcontroller is used in the pen then the speech to text 
conversion may take place in the portable computer unit. A suitable vibrating 
motor for use as a silent alarm can be obtained from Murata of Japan. Situating 
the annunciator towards the barrel of the pen near the tip improves transmission. 

The microcontroller may cause audio feedback of the current position of 

15 the stylus, for example by causing sounds of flicking pages when the pen is tilted 
forward or back. 

While most emphasis herein has been on the display of alphanumeric, 
Katakana or Cyrillic characters, graphic information may also be viewed. For 
example, a file holding pictures related to a person may include three dimensional 
20 picture of that person's face. By revolving or tilting the computer the view may 
switch from a front view to a profile aspect. It will also be appreciated that an 
atlas may be stored in the data store and maps may be rotated to align with the 
direction of travel for example. 

Additional functionality may be introduced to the hand-held computer by 
25 including a touch screen in front of the display screen such that a stylus can be 
used to select text or to cause localised movement of a cursor. 

An autolocate function may be built into the microcontroller such that if no 
movement, ie no change in tilt of either the enclosed accelerometers occurs for a 
selectable period, probably 24 hours, the unit will sound an alarm at periodic 
30 intervals so that the user can locate it. 

Note that the tilt sensors included herein measure tilt with respect to 
earth's gravity by use of a small beam arrangement. Other position sensors may 
be included. Global positioning by satellite is also a possible method of detecting a 
change in the position of the portable computer. 



.02/10/98 1,6:32 i:\users\patents\word\254J4jdoc 




18 



In a symbol counted mode it is possible for a user to flick the pen either as 
a tick or a cross, for example, in relation to a submitted document. The number of 
ticks or crosses may be counted and the result accumulated and transferred to 
data store or accumulated in a spreadsheet to which the user may input names, 
5 titles and the like. The use of other symbols in anticipated. 

While as hereinbefore described the security signature is by use of 
acceleration, a pressure detector may be incorporated into the end of the device to 
further increase security by measurement of the profile as well as the two 
dimensional or three dimensional spatial sensor. 
10 As has been mentioned hereinbefore, a number of keys, switches and 

~ buttons are provided on the casing of the portable computer. In a further 

H> implementation an on/off switch may be provided operated by pressure on the 

3 Jf "nib-end". Whilst such switch pressure is not used for detecting input text per se, 

yp it may be used to turn functions on and off. This may be used in a normal writing 

12 15 mode, for example, touching the pen tip against a writing surface to turn on the 

f accelerometer detection functions. Releasing pressure on the tip then stops the 

q accelerometer signals being considered as potential input to be decoded. 

l z Any of the other switches may be used in certain modes to turn on or off 

text detection, for example, or to stop screen scrolling for example. 
^ 20 Calculator functions in the portable computer may be provided simply by 

writing the numerals and appropriate mathematical symbols in the normal manner. 
The tilt sensor software will determine the numerals and characters entered and 
perform an appropriate calculation for display on the display screen. 

A further function, for example for clock setting causes display of an 
25 analogue clock face on the display means 5. Time changes may be entered by 
selecting an appropriate mode and moving the user's wrist. Tilt sensing is used to 
determine forward or backward adjustment of the time stored. 



